Segmentation of non-rigid video objects using long term temporal consistency
نویسندگان
چکیده
This paper presents a new object-based segmentation technique which exploits a large temporal context in order to get coherent and robust segmentation results. The segmentation process is seen as a problem of minimization of an energy function. This energy function takes into account a data attach term and spatial and temporal regularization terms. The proposed technique used to minimize this energy function is decomposed into three main steps: 1) definition of a technique for retrieving potential objects (referenced as seed extraction), 2) motion estimation for each seed, and 3) final classification performed by minimizing the energy function using a clustering-like technique. The proposed segmentation technique has been validated on real video sequences.
منابع مشابه
Unsupervised Video Segmentation via Spatio-Temporally Nonlocal Appearance Learning
Video object segmentation is challenging due to the factors like rapidly fast motion, cluttered backgrounds, arbitrary object appearance variation and shape deformation. Most existing methods only explore appearance information between two consecutive frames, which do not make full use of the usefully long-term nonlocal information that is helpful to make the learned appearance stable, and henc...
متن کاملNon-rigid Objects Detection and Segmentation in Video Sequence Using 3d Mean Shift Analysis
A new technique for robust detection and segmentation of non-rigid objects in video sequence is proposed in this paper. In our approach, spatio-temporal mean shift analysis (MSA) is employed to convert raw video/object data to their corresponding 3D/2D region feature spaces (RFS) respectively. The distance metric of RFS can be defined based on its spatio-temporal continuous property. Within the...
متن کاملLong-term moving object segmentation and tracking using spatio-temporal consistency
The success of object-based media representation and description (e.g., MPEG-4 and –7) depends largely on effective object segmentation tools. In this paper, we expand our previous work on automatic video region tracking and develop a robust-moving objects detection system. In our system, we first utilize innovative methods of combining color and edge information in improving the object motion ...
متن کاملTemporal Semantic Motion Segmentation Using Spatio Temporal Optimization
Segmenting moving objects in a video sequence has been a challenging problem and critical to outdoor robotic navigation. While recent literature has laid focus on regularizing object labels over a sequence of frames, exploiting the spatio-temporal features for motion segmentation has been scarce. Particularly in real world dynamic scenes, existing approaches fail to exploit temporal consistency...
متن کاملMulti-body Segmentation: Revisiting Motion Consistency
Dynamic analysis of video sequences often relies on the segmentation of the sequence into regions of consistent motions. Approaching this problem requires a definition of which motions are regarded as consistent. Common approaches to motion segmentation usually group together points or image regions that have the same motion between successive frames (where the same motion can be 2D, 3D, or non...
متن کامل